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Multiqueue Systems 
with Nonexhaustive Cyclic Service 
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(Manuscript received July 14, 1978) 

Queuing models with eye lie- type service are applicable for perform- 
ance studies of polling mechanisms in data communication and 
switching systems or cyclic scheduling algorithms in real time com- 
puters. This paper provides an approximate analysis of the multi- 
queue system Afl^/G/l with batch Poisson input, general service 
times, general overhead (switchover) times, and a single server op- 
erating under a cyclic strategy with nonexhaustive service of queues. 
Based on a new concept of conditional cycle times, the generating 
function of the stationary probabilities of state, the Laplace-Stieltjes 
transforms of the delay distributions, and the mean waiting times are 
derived explicitly for each queue through an imbedded Markov chain 
approach and an independence assumption. The approximate ana- 
lytic results are validated by computer simulations. Besides this 
analysis, a stability criterion is derived for the general case ofGI/G/ 
1 systems with cyclic priority service. The paper concludes with a 
number of studies of the behavior of cyclic queues discovering inter- 
esting properties such as the dependence of cycle times and waiting 
times on the arrival and service process types and on the efficiency of 
cyclic priorities. 

I. INTRODUCTION 

Cyclic service is a frequently used mechanism for the information 
transfer between peripheral units and their centralized control opposed 
to asynchronous or synchronous interrupt mechanisms. In a cyclic 
service operation, the centralized control scans the peripheral units in 
a cyclic sequence. At each peripheral unit, the queue of waiting items 
(user or control data) is served either completely ("exhaustive service") 
or up to a specified maximum number of transferred items per scan 
("nonexhaustive service") until the centralized device switches over to 
the succeeding unit within the cycle sequence. Examples of this type 
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of operation are found in data communications systems (polling, asyn- 
chronous multiplexing), telephone switching systems (device scan- 
ning), and certain I/O mechanisms of real-time computers. The per- 
formance of these cyclic service mechanisms is of considerable interest 
for traffic engineering, namely with respect to throughput and resource 
utilizations, delays, unbalanced load, overload behavior, and the influ- 
ence of various statistical properties of the traffic. 

In the sequel, we refer to the general cyclic queuing model shown in 
Fig. 1. There are g arrival groups of "customers" and their correspond- 
ing waiting lines (queues). Customers of group j arrive according to a 
general independent (GI) arrival process with probability distribution 
function (pdf) Aj(t) = P{Taj < Of where Taj denotes the random 
variable of the interarrival time in queue j,j = 1, 2, • • •, g, and A, = 1/ 
ET Aj defines the arrival rate of customers in queue/ Special cases of 
the GI arrival processes are: D (deterministic), M (Markovian), E k 
(Erlangian order k), or H 2 (hyperexponential order 2). In case of batch 
arrivals, the arrival process is defined by both the random interarrival 
time T B j of batches and the random batch size K jt j= 1,2, ■ • • , g. The 
batch size in queue/ is given by its probability distribution qjk — P{Kj 
- k), k - 0, 1, •••. The total arrival rate of /customers A, and the 
arrival rate of batches \ B j are related to each other through A, = \ B j • 
EKj. For the special case of deterministic arrival processes in more 
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Fig. 1 — Cyclic queuing model. 
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than one queue, a "phase shift parameter" is additionally needed 
which describes the relation between the periodic arrival patterns in 
those queues. 

Similarly, customers of queue j receive a random service time Thj 
with pdf Hj(t) = P{ Thj < t) and mean hj = ET H j, j - 1, 2, • • • , g. Once 
the server has finished service at a particular queue j, it switches to 
the succeeding queue in a finite switchover (overhead) time Tuj with 
pdf Uj(t) = P{Tuj ^ t) and mean uj = ETujJ - 1, 2, - - ., g. 

Finally, the general nonexhaustive cyclic operation of the server 
may be specified by a sequence ("cycle") {i\, i 2 , ■••,*/}, where i* € (1, 
2, • • • , g) denotes the number of that queue which is served in &th 
position within the cycle (/ = cycle length). The sequence {i\, h, • • •, 
ii} is repeated in a cyclic manner. If there is no customer to serve from 
the i*th queue, the server switches over to the i*+ist queue (modulo /). 
An example of this general (mixed) cyclic sequence for g = 3 queues is 
{1, 2, 1, 3, 1, 2), where / = 6. In this case, an overhead phase is inserted 
after every queue visit. Cyclic schedules with different frequencies of 
visits at the various queues within a cycle will also be referred to as 
"cyclic priority service." An important special case of cyclic priority 
service is obtained when all visits at a particular queue within a cycle 
are clustered such that the server attends queue 1 successively up to 
h times, queue 2 successively up to h times, and so on (/ = l\ + h + • 
• • + l g ). In this case, an overhead occurs only when changing to 
another queue. Limiting cases of this schedule are cycles with /, = l,y 
= 1, 2, • • •, g ("ordinary cyclic service" .{1, 2, • • •, g)) or cycles with Z, 
:» l,y = 1, 2, • • •, g ("exhaustive cyclic service"). The queuing analysis 
in this paper is limited to the practical important case of ordinary 
cyclic service; for stability and simulation studies the more general 
(nonmixed) cyclic priority service will be considered. 

Queues with cyclic service have received considerable attention in 
literature (see Refs. 1 to 16). Cyclic queues with exhaustive service 
with or without overhead have been treated in case ofM/G/1 models 1 " 8 
and in case of discrete arrival and service processes. 9 The case of 
nonexhaustive cyclic service involves considerable mathematical dif- 
ficulties and has been treated rigorously only for M/G/l models with 
two queues without overhead. 1011 Because of the mathematical intract- 
ability of most cyclic queuing problems, several approximate methods 
were suggested. 12 " 16 The approximate methods usually rest on some 
simplifying assumptions such as the "independence assumption" 12 
under which the stochastic processes within a particular queue are 
considered more or less independent of the processes within the other 
queues. 

In Section II of this paper, we first derive a stability criterion for 
queues of the type GI/G/l with cyclic priority service. Section III 
deals with the cycle time analysis for GI/G/l queues in case of ordinary 
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cyclic service. Sections IV and V present an analysis of the probabilities 
of state and the waiting times for cyclic queuing models of the types 
M/G/l and M [X] /G/1 with ordinary cyclic service and general over- 
head, respectively. In Section VI finally, we report various numerical 
results of the approximate analysis and of computer simulations for 
validation and qualitative performance studies. Some of those results 
discover new insight into the properties of cyclic queues and could 
have direct consequences for system engineering and future research 
as well. 

II. STABILITY OF CYCLIC QUEUES 

Contrary to most standard queuing problems, an obvious and simple 
criterion does not exist under which a queue in a cyclic queuing system 
stays stable. In the following sections, we develop a stability criterion 
for GI/G/1 multiqueue systems with a (nonmixed) cyclic priority 
service. 

2.1 A stability criterion for queues with cyclic priority service 

Following analogously to a common definition for stability in system 
theory, a queuing system will be called "stable" if for positive service 
times and finite input rates the average queue lengths are limited (note 
that a stationary queue is stable, whereas a stable queue need not 
necessarily be stationary). Additionally, we assume that all arrival and 
service processes are stationary so that the following reasoning can be 
based on average values independent of specific distributional assump- 
tions. 

Let T c be the random cycle time, c = ET C the average cycle time, 
and Co = Ui + u-2 + • • • + u g the average of the cycle time under the 
condition that no customer is served during a cycle. The average 
number of arriving j customers during a cycle is nj = \j c. In the 
stationary state of the system, the average number of arriving j 
customers equals the average number of served j customers, j = 1, 2, 
• • • , g. Thus, we have 

g 
c = c + £ (K-c)hf, 



from which we find the result 

Co 



c = 



1 ' 

1 — Po 



(1) 



where p = pi + 92 + • • • + Pg defines the total server utilization and 
p, = Xjhj is the server utilization by j customers only, j = 1, 2, ••-,g. 
The result according to (1) has already been discovered for cyclic 
queues with exhaustive and ordinary cyclic service. To find the bound- 
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ary of system stability, we proceed as follows: First, we state a stability 
criterion for a particular queue j under the condition of stability of the 
residual queues. This condition can always be achieved for sufficiently 
small arrival rates in the residual queues. The whole system is stable 
if and only if all individual stability conditions are satisfied simulta- 
neously. 

Under the condition that all queues v =£ j are stable, queue /' 
approaches the stability boundary as nj — * If, this corresponds to a 
maximum arrival rate Ay max at the margin nj = lj and an average cycle 
length cf: 

X/max*-T, where cf -— —*— . (2a) 

cf 1 - po + pj 

Thus, the system is stable if for all queues 

/, 

Ay < Ay max = f—-.(l-p + pj), j=l,2,---,g, (2b) 

Co + Ijhj 

are fulfilled simultaneously. In a similar way, criteria of partial stability 
can be stated in cases where some queues are saturated (a saturated 
queue i contributes to the average cycle time by h-hi). Finally, it 
should be noted that the average cycle time c stays always stable since 
c < Co + lihi + • • • + Ighg. 

2.2 Examples 

To further explore the stability criterion, consider the example of 
g = 2 queues. From (2b) we find the following relationships between 
A] and A 2 : 

A,< L--.(i-Aifti). A 2 < — ^— .(1-AiAi), (3a, b) 

Co + lihi Co + fe/*2 

where Co = U\ + u 2 . These relationships are shown graphically by two 
marginal lines in Fig. 2 with the intersection 



1 

Co + l\hi + /2/12' 



Ayo = ,,/,,, , /' = 1, 2. (4) 



The absolute stable region is below the hatched area when both 
individual criteria (3a), (3b) are fulfilled simultaneously. For Ai < Ai D 
queue 2 always saturates first, whereas for A 2 < A20 queue 1 saturates 
first. At the intersection (Ai Q , A 2o ), both queues saturate simultane- 
ously. Similarly, for Ai > Ai G , A 2 > A 20, both queues are saturated 
(absolute unstable region). Within the intermediate regions Ai > Zi«(l 
- AsAs)/(cb + l\hi), A 2 < A2«, (or A 2 > Ml - Ai/ii)/(c + l 2 h 2 ), A, < 
Aio), queue 1 (or queue 2) is saturated, whereas queue 2 (or queue 1) 
is stable; in these regions of partial stability, the cyclic queuing system 
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Fig. 2— Stability regions for a GI/G/1 queuing system with 2 queues and cyclic 
priority service. 



can be considered as consisting only from the stable queue where the 
contribution of the unstable queue to the cycle time affects as an 
increased cycle time overhead of h (or l 2 ) consecutive service times 
T H \ (or T W2 ). Furthermore, starting from any point within the absolute 
stable region and increasing Ai and X 2 simultaneously, we state that 
the queue with the greater \j/lj ratio reaches saturation first, inde- 
pendent of the service and overhead time parameters. This statement 
differs from many other queuing stability criteria. 

Finally, we discuss briefly two important special cases of the above 
example. The first special case is that of ordinary cyclic service (/i = 
h = 1). The intersection in Fig. 2 falls on the median Ai = X 2 . This 
means that the queue with the greater arrival rate always saturates 
first. This result was already found by M. Eisenberg 11 for M/G/l 
systems without overhead. Additionally, the average number of j 
customers served during a cycle is identical with the probability a y 
that the server meets at least one customer in queue j: 



OLj = XjC = 



Co 



1 — po 



Ay, .7 = 1,2. 



(5) 
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The second special case is that of exhaustive cyclic service (/i, h 5> 1). 
In this case, both marginal lines fall together on Ai h\ + \ 2 h 2 = 1. The 
stability criterion is simply Ai/ii + A2/12 = pi + P2 = po < 1. Approaching 
the stability margin, both queues saturate simultaneously independent 
of Co. 

III. CYCLE TIME ANALYSIS 

In this section, we consider multiqueue systems of the type GI/G/1 
with overhead and ordinary cyclic service. Since the queuing analysis 
in Sections IV and V is based on the knowledge of cycle time, we 
briefly discuss a known result and then develop an improved approxi- 
mate solution for the pdf of the cycle time. 

3. 1 Cycle time analysis by Hashida and Ohara 

The exact solution for the pdf of the cycle time Tc is still unknown, 
except for the mean c in (1). Based on the probabilities a, in (5) and 
the approximation assumption of independence, Hashida and Ohara 13 
gave the following expression for the Laplace-Stieltjes transform (lst) 
of the cycle time pdf C(t) =P{T c <t}\ 

g g 

<f>c(s) = J] eMs).TT («*«(•) + [1 " ««])■ (6) 

1-1 1-1 

In (6), (f>c(s) = Jo- e~"'dC(t) defines the lst of C(t); similarly, 4>ui(s) 
and <t>m(s) denote the lsts of Ui(t) and Hi(t), respectively. The 
expression (6) follows directly when considering Tc as a sum of 
independent random variables. 

From (6), the exact mean cycle time c follows straightforwardly and 
agrees with (1). However, it was found by intensive simulations (some 
of them are given in Section VI) that (6) underestimates the cycle time 
variance and, herewith, also the mean waiting times. For this reason, 
we shall now improve the cycle time analysis by introduction of a new 
concept of "conditional cycle times." 

3.2 Conditional cycle times 

The basic idea of the queuing analysis in Ref. 13 and in Sections IV 
and V of this paper is the description of the queue length of a particular 
queue j at the scan instant by an imbedded Markov chain. The 
influence of all queues vi*jon the considered queue j will be expressed 
only through the cycle time. The cycle time Tc is the time interval 
between two successive scan instants of a queue (say, j). However, a 
particular realization of Tc clearly depends on whether ay customer is 
served or not in a cycle. Therefore, we introduce two conditional cycle 
times 7c; and Tc-, with respect to the considered queue j for cycles 
without or with a service time contribution to the cycle by a customer 
of queue j, respectively. The corresponding cycles are denoted by C> 
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and C/. Since ET C ; > ET Cj , it is more likely that after a long cycle 
another long one is followed, and vice versa. Thus, the concept of 
conditional cycle times increases the cycle time variance through a 
reduction of the independence assumption by explicit consideration of 
some history of a current cycle. 

Let C'j(t) and C"(t) be the pdfs of the conditional cycle times T Cj 
and Tq$ and a'fi, <x"i the corresponding probabilities for the service of 
an i customer (i ¥> j) during a conditional cycle without or with ay 
service, respectively. Then, it follows by similar reasoning as for (6): 

8 

<t>c,(s) = n 4>ui(s)-J[ (a&mis) + [1 - a'ji]), (7a) 

i-i »»*/ 

<t>c;(s) = n <Ms)-II («* *«(«) + t 1 - «*])•*»<«). (7b) 

i-l ft*y 

For the (unconditional) cycle time Tc we find from the law of total 
probabilities 

<t>c(s) = (1 - aj)<t> Cj (s) + aj<t>c-(s). (8) 

With c'j = ET C and cf = ET& we state the conditional cycle time 
balances: 

c'j = co + £ a;*/*,, (9a) 

«'»*/ 

c ; = co + £ a^/i, + A y , (9b) 

ftV' 

c = (1 - o(f)c; + flj/c/. (9c) 

Similarly, as in (5), we assume 

a'ji = Xic'j, (9d) 

a?i = \iC?, i*j. (9e) 

Inserting (9d), (9e) in (9a), (9b), we find 

c;= °\ , (10a) 

1 - po + p, 

c/- i q, + ^ ■ (10b) 

1 - po + Pj 

Note that the exact value of c in (1) follows from (9c) and (10a), (10b). 
It should also be mentioned that the solution (10a), (10b) holds only 
as long as aft < 1. This condition is always fulfilled in case of symmet- 
rical load (Ai = A 2 = • • • = X g , hi = h 2 = • • • = h g ). In case of higher 
unsymmetrical loads, it can indeed happen that a"i > 1 so that aft can 
no longer be interpreted as probability; this difficulty can be overcome 
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by a suitable limitation of a$ by 1 (i.e., queue i always contributes a 
service time to the conditional cycle time Tcj). 

With (9d), (9e) and (10a), (10b), the conditional cycle time pdfs Cj(t) 
and Cj'(t) are completely defined. The mean conditional cycle times 
Cj and c" are given by (10a), (10b). For the variances, we find from 
(7a), (7b): 

var T C) = S var Tm + S («V^" " «#•**). (Ha) 

VAR T C ; = J VAR T« + 2 («jfM" - ttjS*.*?) + VAR T Hj , (lib) 

i-i ivy 

where /i} 2) = £Th, denotes the ordinary second moment of Tm. The 
cycle time variance is finally given by 

VAR Tc = (1 - ay) -[VAR T C ; + cf] + a,- [VAR T C ; + c/ 2 ] - C 2 . (lie) 

The second moments of the cycle times follow from the definition 

VAR Tc = C (2) - C 2 . 

IV. QUEUING ANALYSIS OF M/G/1 SYSTEMS 

Based on the concept of the conditional cycle times of Section III, 
a queuing analysis is given for multiqueue systems of the type M/G/1 
with general overhead times and ordinary cyclic service by means of 

an imbedded Markov chain. Basically, the derivation follows the 
approach of Hashida and Ohara. 13 

4. 1 Probabilities of state 

For an exact analysis, the state of the system at a time t has to be 
defined such that all past history is summarized in it so that the future 
development of the system state process is completely determined 
from it. In the present case, the system state could be described by a 
vector {Ni(t), N 2 (t), • • • , N g (t), I(t), X (t)}, where Nj(t) defines the 
number of waiting customers in queue j,j — 1, 2, • • • , g, I(t) points to 
the present location of the server within the cycle, and Xo(t) specifies 
the age of the current service (or overhead) phase of the server. An 
exact analysis on this base seems not to be feasible. 

In the following analysis, only the state Nj of a particular queue j is 
considered. Moreover, the analysis does not apply to continuous time 
but is restricted to a set of special points, namely the scan instants (or 
departure instants) of the considered queue j. The time intervals 
between the scan instants of queue j are the conditional cycle times 
Tc- and Tcf, the influence of all the other queues on the queue length 
process in queue j is completely expressed by those cycle times. 
Although the following imbedded Markov chain solution is formally 
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exact, the analysis approach is approximate since T Cj Tc t are 
assumed to be independent and identically distributed (iid) variables; 
the expressions for their pdf are only approximations, too. 

The outlined method only renders results for the particular queue j 
under consideration. In the case of unsymmetrical systems, the pro- 
cedure must be repeated for the other queues, too. For ease of reading, 
we suppress the subscript j in the following treatment, i.e., we write 
X, h, p, c', c", • • • instead of X>, hj, pj, Cj, c" 

4.1.1 State distribution at scan instants 

We assume that the queuing sytem is in the stationary state. Let N 
be the number of waiting customers at the server arrival instant (scan 
instant) of a particular queue. We are interested in the stationary 
distribution 

p n = P{N = n}, n = 0,1,2,-... (12) 

Because of the memoryless property of the arrival process, the system 
state of the considered queue forms an imbedded Markov chain at the 
discrete set of scan instants (renewal points). The stationary distribu- 
tion satisfies the equation (see Ref. 17, pp. 167-174): 



n+l 



Pn=P0'P0n+ 2 Pm'Pmn, Tl = 1, 2, • • ■ , (13a) 

m-1 

where the transition probabilities p mn are given by 



Pmn 



vn— m+1 



t-0- 



I 



g _x< # <A*V_ dC "(t), m>0 

(n -m + 1)! 



^f • dC'(t), m - 0. 



(13b) 



Together with the normalizing condition 

1 Pn = 1, (13C) 

the stationary probabilities of state at the scan instants are completely 
determined by the set of equations (13a), (13b), and (13c). Introducing 
the probability generating function of the state distribution p n , n = 0, 
1, 2, ..• , 

G(x) = X p n x", (14) 

n-0 
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we obtain after some algebraic manipulations 

x<i>c(z) -<f>c-(z) 

G(x)=p Q - — , where z = A(l - x). (15) 

x - <t>c-(z) 

Note that G(x) is completely expressed by po and the lsts of the two 
conditional cycle times. Using the identity G(l) = 1, we find from (15) 
through evaluation of lim.x_i G(x) by L'Hospital's rule 

1 - Ac" 

"- i-Mc»-c'r 1 - g - (16) 

The latter identity can be shown by using equations (10a), (10b), and 
(5). 

The expected number of waiting customers at the scan instant 
follows from 

EN = 4- G(x) 
ax 



This results in 



Ac' (2, .(l - Ac ") + c'(A 2 c" (2) + 2 - 2\c") 
2(1 -Ac") 5 



EN = po-\ '— x T - jr - 2 ', (17) 



where c' (2) = ETh, and c" (2) = ETh. 

4. 1.2 State distribution at departure instants 

Let N* be the number of waiting customers within the considered 
queue which are left behind by a departing customer of that queue 
with distribution 

p*=P(N* = n), n = 0,l,2,-.. (18) 

and generating function 

G*(x) = l p*x n . (19) 

n-0 

The probability p* can be expressed through the probability of having 
m customers at the scan instant given that the considered queue is not 
empty, p m /(\ — po), and the probability of n — m + 1 new arrivals in 
that queue during the subsequent service time of one customer. Hence, 

P»*=Er^--| r* • ; — t n , • dH(t), 

m _! 1 - po J,_ _ (n-m + 1)! 

n = 0, 1, 2, • • • . (20) 
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Substituting (20) in (19) and interchanging the order of summation 
and integration, we find 

g .(»)._!_. C <*)-^ .^ W , (21) 

1 ~Po X 

where 

z = \(l-x). 
Therefore, it follows for the expected number of customers at the 
departure epoch: 



EN*=-^-G*(x) 
ax 



EN -l + p. (22) 



-1 



1 -po 



On the other hand, EN* equals the expected number of customers 
which have arrived during the sojourn (waiting + service) time of the 
departing customer (for this, consider as an example the queue disci- 
pline fcfs, first come, first-served). Hence, EN* - X-(w + h), where 
w = ET W denotes the average waiting time in the considered queue 
(service being excluded). Solving for w, we find with (22) 



4.2 Delay analysis 

For the following derivation, the queue discipline fcfs is assumed. 
Let T w be the waiting time which an arbitrary customer of the 
considered queue (in the following denoted by "test customer") has to 
undergo with pdf W(t) and lst $w(s) . Through an analogous reason- 
ing as in the previous section, p* can alternatively be considered as 
the distribution of the number of arriving customers during the sojourn 
time T s of the test customer. Since Ts = Tw + T H and since Tw and 
T H are independent of each other, the pdf of T s is the convolution of 
W(t) and H(t), symbolized by W(t) © H (t). Hence, 

p * = [ e -w .^l.d(W(t) © H(t)), /i = 0,l,2,.... (24) 

Applying (19) in (24), we find G*(x) - 4>w(z) >$h(z), where z = X(l 
- x), which, with (21), finally results in 

4>w{S) = ; r— — j-tz. \*0) 

c' s- A-[l -<t>c"(s)\ 



From (25) we find for the mean waiting time 

c /(2> Xc *m 



w = — r <t>w\s) 
as 



2c' 2(1 -Ac") 

s=0 



(26) 



682 THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1979 



Equation (26) reveals that the mean waiting time depends basically on 
the first and second moments of the conditional cycle times. Note also 
that (26) agrees with (23) when the corresponding results forp , EN, 
c', c", c ,(2) , and c" (2) from eqs. (16), (17), (10a), (10b), and (11a), (lib), 
respectively, are inserted. 

It may be mentioned that the result (26) can also be derived directly 
through the application of renewal theory and Little's law: An arriving 
test customer of the considered queue meets either a cycle C or C" in 
progress. Since the arrival process is a Markovian process, the proba- 
bilities of meeting a cycle C or C" is simply the weighted ratio of 
frequencies, i.e. (1 - a) • (c'/c) or a • (c"/c), respectively. According to 
our approximation assumption, the conditional cycle times Tc and Tc 
are iid- variables. Thus, the average residual cycle times are c' (2) /2c' 
and c" (2) /2c" according to renewal theory (see, for example, Ref. 17, 
pp. 158-161). The average waiting time w consists of the average 
residual cycle time and the product of the mean cycle time c" and the 
average number L of customers met at the arrival instant of the test 
customer; the latter one can be expressed through Little's law (see, for 
example, Ref. 17, pp. 156-158) through L = \>w. The average waiting 
time w can now be balanced as 

c' c' l2) c" c" (2) 

w=(l-a).--— + a — r + (\w)c". (27) 

c 2c c 2c 

Solving for w, we yield precisely the result (26) from (27). 

The pdf W( t) can be obtained by the inversion of (25) either through 
a partial fraction expansion (in case of rational lsts), by the numerical 
inversion technique of D. Jagerman, 18 or by an approximation using 
the ordinary first and second moments. 19 

Finally, we mention that (25) includes the exact result for the 
limiting case g = 1 of a single cyclic queue with overhead. Furthermore, 
another limit with zero overhead can be derived from (25); this case 
represents the worst case with respect to the approximation accuracy 
(see Section VI). 

V. QUEUING ANALYSIS OF M IX] /G/1 SYSTEMS 

In this section, the solution of Section IV for single Poisson arrivals 
(M) is generalized to batch Poisson arrivals (M [X] ) in every queue. 
The analysis follows analogously to Section IV; i.e., we consider all 
processes with respect to a particular queue j. Again, the subscript j 
will be suppressed for ease of reading. 

5. 1 Probabilities of state 
5.1.1 Arrival process 

Customers of the considered queue arrive in batches of size K with 
distribution 
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q k -P{K = k), £ = 0,1,2, ... (28a) 

and probability generating function 

Q(x) = l qkX k . (28b) 

A-0 

The interarrival times of batches are exponentially distributed with 
mean 1/Au = EK/\, where A and \ B are the arrival rates of customers 
and batches within the considered queue, respectively. 

Let N B (t) be the number of batch arrival instants in (0, t) with 
distribution 

P{N B (t) = n) = ^^- • e" Afl ', n - 0, 1, 2, • • • (29a) 

and probability generating function 

(\ B t) n 



g(x, 0-2 



. p~ Xb ' . x n = e ~ XBl{1 ~ x) 



(29b) 



"o n\ 



Finally, let N A (t) be the total number of customers arriving at the 
considered queue in (0, t). Then, the probability generating function 
of the distribution P{N A (t) - *} , * - 0, 1, 2, • • • , ifl given by 

h(x,t)=Z P{N A (t) = k)-x k =g(Q(x),t) = e-^- Q(x) \ (30) 

k-0 



5. 1.2 State distribution at scan Instants 

Since the cycle time approximation of Section III holds for GI/G/1 
cyclic queues, the same pdfs C(t), C'(t), and C"(t) can be used for 
batch arrival processes. As in Section 4.1., let p n be the stationary 
probability of state for n customers waiting within the considered 
queue at the scan instants. The transition probabilities pmn in (13a) 
are now 



Pmn 



£ 

Jt-o- 



I P{N B (t) = v) 



»-0 



P{N A (t) = n - m + 1| N B (t) = v)-dC"(t), m > 



(31) 



Jt-o- 



I P{N B (t) = v) 



K-0 



•P{N A (t) = n\N B {t) = v) • dC'(t), m= 0. 
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The probabilities of state p n are completely determined by (13a), (31), 
and (13c). The application of the generating function results finally in 
the same expression for G(x) as in (15), however, with z = \ B - [1 - 
Q(x)] t where Q(x) is defined by (28a), (28b). Also, forp„ the identical 
result is obtained as in (16). Further results can easily be derived 
analogously as in Section 4.1. 

5.1.3 State distribution at departure instants 

Using the same definitions forpZ and G* (x) as in Section 4.1.2, we 
find, instead of (20), 

pir-lE-fit-. I ip{N B (t) = v).p{N A (t) 

m _i 1 - p J /-0 „_o 

= n-m+l\N B (t) = p}dH(t), n = 0, 1, 2, • • - . (32) 

This again results in the same expression for G*(x) as in (21) with z 
= \b'[1 — Q(x)~\, from which further results could be derived analo- 
gously. 

5.2 Delay analysis 

Following the method outlined in Secton 4.2, p* is also the distri- 
bution of the number of arriving customers during the sojourn time of 
a test customer of that queue. The number N* of customers left behind 
in the considered queue by the departing test customer is now built up 
from two components: 

N* = Nt + N$, 

where 

Nf = the number of customers that had arrived together with the 
test customer in one batch but that were behind the test 
customer 

N* = the number of customers that had arrived in subsequently 
arriving batches during the sojourn time T s of the test cus- 
tomer. 

Let r„ = P [Nf = n) , n = 0, 1, 2, • • • , be the probability that the 
departing test customer leaves n customers behind which had arrived 
together with the test customer in one batch. The test customer 
arrived in a batch of size K = k with probability (see Ref. 20) 

The test customer is first, second, • • • , £th in the batch of size k with 
probability 1/k. Thus, qt /k defines the probability that the test 
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customer arrived in a batch of size k in (k - n)th position, n = 0, 1, 2, 
... ,k-l. Then, 

r «" 2 X = ^T 2 9*. n = 0,l,2,..-, (34) 

and probability generating function 

Now, we can establish the relation between p^ and T s analogously as 
in Section 4.2: 

Pn*= f [£ P{OT = /0-£ P{WU)-»-/i|A&(*)-i'} 



■P^att)-*} 



d(W(«) ® H(t)), n = 0, 1,2,.-.. (36) 



In (36), the bracket term expresses the probability of new arrivals 
within a sojourn time of length t through consideration of all principal 
possibilities of batch configurations of the departing test customer. 

Introducing r„ and R(x) from (34) and (35) and applying (19) on 
(36), we find after some intermediate calculations 

G*(x) = <t>w(z)-<t> H (z)-R(x), (37) 

where 

z = \b[1-Q(x)]. 

Equating both expressions in (21) and (37) yields the final result 

, . 1-AC" 1-«M«) 1 ,oo Q , 

^ (s)= ^^^7)^-l*u)' (38a) 

where x = f(s) the solution of 

s = Xb[1-Q(x)]. (38b) 

From (38a), (38b), we find for the mean waiting time of a customer 

EK 2 



"\2c' + 2(l-\c")/ 



c 
w 



2(1 - \c") 



EK 



- 1 



(39) 



Note that the mean waiting time consists of two terms; the first term 
is identical with that of an M/G/l system [see (26)], whereas the 
second term expresses the influence of batch arrivals. 

Analogously to Section 4.2, the mean waiting time can be derived 
directly. Let w(i) be the mean conditional waiting time of a customer 
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who is ith in his batch. For w(l), a similar balance can be stated as in 
(27): 



c' c" 2) c" c" (2) 



w(\) = (1 - a) —-5-7 + a- — — — + (\w)c". (40a) 

The relationship between w(\) and ep(i) is 

w(i) = w(l) + (i-\)-c". (40b) 

The mean waiting time w, irrespective of the test customer's position 
within the batch, follows by averaging over the conditional waiting 
times. Thus, with (33) and (40b), we have 



-iiH-2-«>— »+?■ 



EK 2 _ 



EK 
Inserting (41a) in (40a) and solving for w(l) yields 

EK 2 



Q — Ac" (2) Ac" (2) 

2c' + 2(1 - Ac") + 2(1 - Ac") 



EK 



- 1 



(41a) 



(41b) 



The mean waiting time w is completely determined with (41a), (41b) 
and agrees with (39). 

Finally, we give the explicit results for w in the case of two special 
batch size distributions. For constant batch size k, i.e., q t = S(i,k), we 
find 

k — 1 c" 
w\m\x\ /g/1 = w\m/g/\ +— - — r-j. (42a) 

A 1 AC 

In the case of geometrically distributed batch sizes, which are defined 
by qi = q l - (1 - q), i - 0, 1, • • - , and q - (EK + 1)/EK, the result is 

c" 

W I M[X] /G/l = W I Af/G/l + ^iiT- r-y . (42b) 

1 — Ac 

The expressions (42a), (42b) demonstrate at first the increase of the 
waiting time through the batch Poisson arrival process compared to 
the pure Poisson arrival process and, second, the increase of w through 
geometrically distributed batches against constant batches. 

VI. NUMERICAL RESULTS 

In this section, the results of the approximate analysis are validated 
by computer simulations. Further results are given to show various 
properties of cyclic queuing systems. 

6. 1 Cycle time variance for ordinary cyclic service 

Since the mean cycle time c according to (1) is always exact, the 
approximation accuracy can be judged in a first step by the cycle time 
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variance var T c (note that even the pdf C(t) of the cycle time would 
not be sufficient for a complete validation since successive cycle times 
are not independent of each other; for a more complete validation, 
some covariance measure should be considered, too). We expect very 
good accuracy for low traffic (since the independence assumption is 
asymptotically exact for zero arrival rates) as well as for heavy traffic 
(since each of the queues contributes in the limit with a full service 
time to the cycle so that the cycle times become independent of each 
other again). 



10 



o.s 



NEWTHEORY 
HASHIDA/OHARA 

SIMULATION RESULT 
WITH 95% CONFIDENCE 
LEVELS 



c =1-0 



0.2 - 



0.1 




c = 0.2 



0.2 



0.4 0.6 

SERVER UTILIZATION (p ) 



Fig. 3— Accuracy of cycle time variances 

Parameters: g = 2 symmetrical queues M/D/l and M/fa/l 

c fl = 2.0 coefficient of variation of service times for M/H 2 /l 
/,, = h 2 «■ 1 average service times 
Co = 0.2 and 1.0, constant overhead. 
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Table I — Cycle time variance for various GI/M/'\ queues with 
ordinary cyclic service 

Parameters: g = 10 symmetrical queues; hj = 1, u, = 0.1 (0.5), Ay = \, j = I, 2, • • • , 10; 
Constant overhead times; D/M/l: Equal phase shift between arrival instants; Hi/M/V. 
Interarrival time coefficient of variation c A = 2.0; M i * i /M/l: Constant batch size k = 4. 



Parameters 




VAR 


Tc (simulation) 




VAR T r 

(approx.) 


Po 


Co 


D/M/l 


E 4 /M/l 


M/M/l 


H2/M/1 


Aflxi/M/l 


GI/M/l 





1.0 




















0.4 


1.0 


1.83 


1.88 


1.91 


1.88 


1.66 


1.38 


0.6 


1.0 


6.60 


5.38 


5.14 


5.03 


4.61 


3.25 


0.8 


1.0 


21.90 


15.40 


14.50 


12.90 


11.00 


9.20 


0.909 


1.0 


10.00 


10.00 


10.00 


10.00 


10.00 


10.00 





5.0 




















0.2 


5.0 


2.23 


2.77 


2.78 


2.81 


2.64 


2.38 


0.4 


5.0 


11.10 


7.85 


7.59 


7.28 


6.66 


5.80 


0.6 


5.0 


21.70 


13.00 


11.30 


10.70 


10.40 


10.30 


0.667 


5.0 


10.00 


10.00 


10.00 


10.00 


10.00 


10.00 



In Fig. 3, var Tc is shown dependent on the server utilization p in 
case of g = 2 symmetrical queues of the types M/D/l and M/H2/I, 
each with two cases of constant overhead. As expected, the cycle time 
variance depends largely on the pdfs of the service and overhead times. 
The solid curves of the new approximation with the concept of condi- 
tional cycle times compare generally better with the simulation than 
the previous theory by Hashida and Ohara, 13 especially for low over- 
head. From a large number of computer simulations for M/G/l sys- 
tems, we made the following qualitative observations: 

(i) The cycle time variance accuracy decreases with increasing 

number of queues and increasing service time variance. 
(ii) The cycle time variance accuracy increases with increasing 
overhead and for approaching the low or heavy traffic region. 
(Hi) Observations (i) and (ii) apply to the new and old theory; the 
concept of conditional cycle times, however, yields generally a 
better accuracy. 
Since the approximation for the pdf of the cycle time is independent 
of the arrival process type, it is interesting to know how the actual 
cycle time variance depends on various process types. For comparison, 
five different GI/M/l systems with g = 10 queues (the accuracy is 
generally better for g < 10), two cases of overhead, and five cases of 
load have been considered (see Table I). Summarizing, we make the 
following observations: 

(i) The cycle time variance depends indeed on the arrival process 
type. This dependence decreases, however, as the load ap- 
proaches the low or the heavy traffic regions. 
(ii) For medium loads, the cycle time variance may decrease as 

the arrival process peakedness increases. 
(Hi) The approximation generally underestimates the true cycle 
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time variance. The accuracy increases with the overhead, the 

peakedness of the arrival process, and as the load approaches 

the low or heavy traffic region. 

At first sight, observation (ii) is counterintuitive and surprising 

since the mean waiting time generally increases with the arrival 

process peakedness (see, for example, Fig. 9). However, regular arrival 

patterns may result in very short and very long cycles since many idle 

cycles could be produced after a service until the next arrival occurs. 
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SIMULATION RESULTWITH 
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SERVER UTILIZATION (p ) 

Fig. 4 — Accuracy of mean waiting times for cyclic queuing systems M/D/l 

Parameters: g = 2 symmetrical queues 

hi = hi = 1 average service times 
cq = 0.2 and 1.0, constant overhead. 
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NEW THEORY 

HASHIDA/OHARA 

SIMULATION RESULT WITH 
95% CONFIDENCE LEVELS 




0.3 0.4 0.5 0.6 0.7 0.8 0.9 

SERVER UTILIZATION (p ) 

Fig. 5 — Accuracy of mean waiting times for cyclic queuing systems M/H2/I 
Parameters: g = 2 symmetrical queues 

h 1 = /12 = 1 average waiting times 

Co =0.2 and 1.0, constant overhead 

ch = 2.0 coefficient of variation of service times. 

On the contrary, batch arrivals may stabilize the cycle time since many 
cycles consist of one service time and the overhead only. Although 
these characteristics depend largely on the parameter combination, 
they indicate some interesting effects which may be important for 
applications and theory as well. 

6.2 Mean waiting time 
Since the mean waiting times in (26) are basically dependent on the 
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first two moments of the conditional cycle times, we can expect the 
same accuracy trends as for the cycle time variance. Figures 4 and 5 
show results for systems of the type M/D/l and M/H 2 /l with two 
symmetrical queues for low and high overhead. The accuracy for MJ 
D/\ is excellent, whereas for M/H 2 /l and low overhead the mean 
waiting time is underestimated. In any case, the new approach yields 
a better accuracy compared to Ref. 13, which results from the condi- 
tional cycle time concept. 
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Fig. 6— Accuracy of mean waiting times for cyclic queuing systems M lXi /D/l 
Parameters: g = 10 symmetrical queues 

hj = 1 average service time, j = 1, 2, • • •, 10 
Co =1.0 and 5.0, constant overhead 
EK = 4 constant (average) batch size. 
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Fig. 7 — Accuracy of mean waiting times for cyclic queuing systems M^^/Ht/l 
Parameters: g = 10 symmetrical queues 

hj = 1 average service time,./ = 1, 2, • • ., 10 

Co =1.0 and 5.0, constant overhead 

EK = 4 constant (average) batch size 

Ch = 2.0 coefficient of variation of service times. 



Figures 6 and 7 show the results for g = 10 symmetrical queues for 
systems M [X] /D/1 (Fig. 6) and M [X] /H 2 /l (Fig. 7), each with constant 
or geometrically distributed batch sizes, low and high overhead. All 
cases of batch arrival processes show an excellent accuracy. Many 
other validations have also shown that the accuracy is far less depend- 
ent on the parameters g, c 0) or G compared to single Poisson arrivals. 
This results from the fact that the cycle time analysis yields the best 
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accuracy in case of batch arrivals; also, the contribution of the batch 
arrivals to the mean waiting time w dominates the expression (39) for 
larger batch sizes. 

Another study on the influence of the service process type G and 
arrival process type GI on the mean waiting time w in case of ordinary 
cyclic service is shown in Figs. 8 and 9 for zero, low, and high overhead. 
The M/G/l curves with overhead are analytic results according to 
(26), whereas the GI/M/1 curves are simulation results; the results for 
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Fig. 8 — Influence of service process type for cyclic queuing systems M/G/l 

Parameters: g = 10 symmetrical queues 

hj = 1 average service time,./ = 1, 2, • • •, 10 

Co = 0, 1.0, 5.0, constant overhead 

Systems M/D/l, M/M/l, M/H 2 /l {c H =» 2.0). 
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zero overhead are exact and have been drawn from standard queuing 
tables by the author. 19 The main conclusions from Figs. 8 and 9 are: 
(*) For M/G/l systems with ordinary cyclic service, the influence 

of the service process decreases with increasing overhead. 
(ii) For GI/M/1 systems with ordinary cyclic service, the influence 
of the arrival process does not remarkably decrease or may 
even increase with increasing overhead (see also Figs. 6 and 7 
for batch arrivals). 
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Fig. 9 — Influence of arrival process type for cyclic queuing systems GI/M/1 
Parameters g = 10 symmetrical queues 

\ = 1 average service time, j = 1, 2, ■ • • , 10 

Co = 0, 1.0, 5.0, constant overhead 

Systems D/M/l, M/M/l, H 2 /M/l (c A = 2.0). 
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These properties are most important for applications since they 
show that the results are much more sensitive to arrival processes than 
to service processes and that the usual approximation of arrival proc- 
esses by Poisson processes may result in a quite dramatic error in the 
performance estimation. Therefore, future analytic studies on cyclic 
queuing systems should aim more to the generalization of arrival 
processes. 




12 3 4 

QUEUE NUMBER 

Fig. 10— Unbalanced load performance of cyclic queuing systems M/D/l 

Parameters: g = 4 queues 

hj = \,j = 1, 2, 3, 4, average service tunes 
Uj = 0.05, j = 1, 2, 3, 4, constant overhead 
\i:Az:Aa:A< = 4:3:2:1 arrival rate ratios. 

696 THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1979 



6.3 Equity of service for unbalanced load 

So far, we have concentrated on cases of ordinary cyclic service. The 
final study shows how cyclic priority service can be used to achieve 
equity of service in cases of unbalanced load. In this case, queue 1 is 
served up to h times, queue 2 up to h times, • • • , queue g up to l g 
times within a cycle, so that h, h, - • • , l e could be considered as cycle 
priorities. Figure 10 demonstrates the use of cyclic priority service in 
case of unbalanced load in a system M/D/l with g = 4 queues and 
arrival rate ratios Ai:A 2 :A 3 :A4 = 4:3:2:1. In case of ordinary cyclic 
service with the cycle {1, 2, 3, 4}, the unbalanced load produces also 
unbalanced waiting times with increasing absolute load po. The dashed 
curves show the result of cyclic priority service where l\\h:h:l\ m \i'. 
X 2 :\3-.>u with the cycle {1, 1, 1, 1, 2, 2, 2, 3, 3, 4}. For small p , both 
schedules do not remarkably differ in performance. In case of higher 
po, the unbalanced load effects can be compensated for by a cyclic 
priority service. 

VII. CONCLUSION 

This paper provides a new approximate analysis for cyclic queuing 
systems M lX] /G/l with batch Poisson arrivals, general service and 
overhead times, and ordinary cyclic service. The method allows a 
relatively easy evaluation of numerical results. The accuracy of the 
method has been validated by computer simulations. In addition to 
the analysis method, a new stability criterion for systems GI/G/1 with 
general cyclic service is developed. A number of traffic studies are 
reported revealing more insight in the traffic performance of cyclic 
queuing systems. 
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